Systems, methods, and computer-readable media for invoking an electronic ink or handwriting interface

ABSTRACT

User interfaces, methods, systems, and computer-readable media for activating and/or displaying text input systems on display devices may include: (a) displaying a text input system activation target at a user changeable location on a display device; (b) receiving user input directed to the activation target; and (c) activating a text input system in response to the user input. Such user interfaces, methods, and systems further may include (d) displaying a pre-interaction condition of the activation target; (e) receiving user input directed to the activation target in this pre-interaction condition; and (f) changing an appearance of the activation target from the pre-interaction condition to a larger size and/or a different visual appearance in response to this user input. Additional aspects of this invention relate to computer-readable media for providing user interfaces, systems, and methods as described above.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.12/501,710, which is a continuation of U.S. patent application Ser. No.11/083,013 (now U.S. Pat. No. 7,561,145), filed on Mar. 18, 2005.

FIELD OF THE INVENTION

The present invention relates to user interfaces, methods, systems, andcomputer-readable media for activating and/or displaying a text inputsystem on a computing system. In at least some examples of thisinvention, the computing system may constitute a pen-based computingsystem that is capable of receiving, processing, and/or displayingelectronic ink data.

BACKGROUND

As the role of computers has expanded, various different techniques havebeen developed for entering data into computers. Recently, pen-basedcomputing systems (such as tablet PCs, personal digital assistants, andthe like) have gained popularity. One particularly useful technique forentering data in such pen-based computing systems is through the use ofhandwriting. By writing with a stylus, electronic pen, or other userinput device on a digitizer, e.g., to produce “electronic ink,” apen-based computer user can forego the bulk and/or inconvenienceassociated with use of a conventional keyboard. Handwritten inputconveniently may be used, for example, by doctors making rounds,architects on a building site, couriers delivering packages, warehouseworkers walking around a warehouse, and/or in any situation when the useof a keyboard would be awkward, inconvenient, and/or undesired. A widevariety of “pen-based computing systems” now are available that allowentry of data via handwriting, e.g., using electronic ink and/or via anelectronic pen.

Not all application programs, however, have been designed to acceptand/or are capable of accepting user input in the form of electronic inkand/or via an electronic pen. For example, many application programs areincapable of accepting data in a format other than machine-generatedtext (e.g., input via a conventional keyboard, downloaded, or input insome other manner). When pen-based computing system users open and usesuch restricted input application programs, attempts to enter electronicink input into areas or fields that are incapable of accepting suchinput will result in error messages, ignored input, erroneous input,lost input, and/or other input issues. Such input entry difficultiesconstitute a source of frustration for users of pen-based computingsystems.

FIG. 1A illustrates an example digitizer and/or display screen 10 of apen-based computing system (e.g., a tablet PC display) on which anapplication program that is incapable of accepting input in the form ofelectronic ink is operating (e.g., a word processing application programin this illustrated example). If this tablet PC user has only thecomputing system's pen or stylus available as an input device, he/shewill be incapable of inputting data into this electronic document and/orotherwise interacting with this application program. In an effort toallow pen-based computing system users to interact with a wide varietyof application programs, including the many existing applicationprograms not designed to accept electronic ink input, at least somepen-based computing systems have been equipped with “text input systems”that allow electronic ink and/or other electronic pen input to be“converted” to a form that the application program will correctlyrecognize and accept. In conventional pen-based computing systems, thetext input system can be activated by tapping the electronic pen on anicon 12 provided at the lower left side of the display screen 10, asshown in FIG. 1A (e.g., adjacent the “Start” button in a “toolbar”provided with at least some graphical user interfaces and/or operatingsystems). In such conventional systems, this icon 12 was a band iconthat constituted a property of the pen-based computing system'soperating system (e.g., the Microsoft® Windows XP Tablet PC EditionVersion 2002 operating system), which allowed bands to be added near the“Start” button.

Tapping the icon 12, in at least some existing pen-based computingsystems and/or their operating systems, activated an interface panel 14through which user input may be entered. For example, as shown in FIG.1B, a user may write one or more characters in the electronic ink inputportion 16 of the interface panel 14 using an electronic pen or stylus.A handwriting recognizer associated with the operating system then wascalled upon to convert the handwritten electronic ink input toconventional machine-generated text (e.g., ASCII text or the like), andthis corresponding recognized and machine-generated text then wasinserted into the electronic document, e.g., at the location of cursor18 when the interface panel 14 was activated and/or at the location ofthe cursor 18 when the electronic ink was entered into interface panel14. In this manner, application programs that were incapable ofaccepting and/or interacting with electronic ink and/or electronic peninput could be adapted to reliably receive input from such sources.

Another example or version of an interface panel 14 for a text inputsystem is shown in FIG. 1C. More specifically, in this illustratedexample, the text input system constitutes a “soft keyboard” 20, whichenabled users to “type” in the desired textual information (e.g., at thelocation of cursor 18) using the tip of the electronic pen (or otheruser input device) to “touch” or “tap” the various keypads of the softkeyboard 20. Again, in this manner, application programs that wereincapable of accepting and/or interacting with electronic ink and/orelectronic pen input could be adapted to reliably receive input fromsuch sources.

While input systems of the type illustrated in FIGS. 1A through 1C havebeen useful and effective, these known systems also have certaindrawbacks or shortcomings. For example, in at least some conventionalsystems, the location of the input system icon 12 is fixed at the lowerleft-hand side of the display screen 10 (e.g., in the lowermosttoolbar). Many users find this location somewhat unnatural and/orinconvenient to use (e.g., because many users interact with and operatein the top half to two-thirds of the display screen 10 in a pen-basedcomputing system, locating the text input system icon in the lowest 5%of the display screen 10 has not been found to be very natural orconvenient). Additionally, in many instances, users tended to forget thepurpose of the icon 12 and/or would activate it only after searching forit (the appearance of the icon 12 in some conventional systems (e.g., asa tiny picture of a keyboard with no associated text) was not readilyvisible or identifiable by users, thereby failing to provide animmediate visual clue as to the purpose of icon 12). These factors makeuse of input panel 14 seem a substantial and inconvenient interruptionin the data entry process. Additionally, in at least some circumstances(e.g., for application programs and/or users that prefer to hide thislowermost toolbar), location of the icon 12 and/or activation of theinterface panel 14 can be difficult or even impossible.

Additional drawbacks relate to the location and features of theconventional input panel 14 when activated. In at least someconventional systems, interaction with icon 12 activated the input panel14 only in a “docked” manner. More specifically, as shown by comparingthe displayed data of FIG. 1A with that in FIGS. 1B and 1C, whenactivated, the input panel 14 takes up a certain portion of the overalldisplay screen 10 height, and the remainder of the displayed data isshrunk to fit within the confines of that smaller display area. Thechanges required to allow this type of resizing and position shiftingcan be somewhat disorienting and disruptive, and it can result ininaccurate data displays.

Accordingly, there is a need in the art for more convenient and improveduser interfaces, systems, and methods that allow use of electronic inkand/or electronic pen data for data entry in various types of systems,application programs and/or data fields, including systems, applicationprograms, and/or data fields that have not been designed to acceptelectronic ink and/or electronic pen input.

SUMMARY

Aspects of this invention relate to user interfaces, methods, systems,and computer-readable media for activating and/or displaying a textinput system on a display device. Such user interfaces, systems, andmethods may include: (a) displaying a text input system activationtarget at a first location on the display device, wherein the text inputsystem activation target is displayed at a first size and/or with afirst appearance characteristic at least when a user input device hoversproximate to the first location, wherein the first location ischangeable in response to user input; (b) receiving a first user inputdirected to the text input system activation target (e.g., a pen tap, anextended hover action, etc.); and (c) activating a text input system inresponse to the first user input. Such user interfaces, methods, andsystems further may include: (d) displaying a pre-interaction conditionof the text input system activation target, wherein the pre-interactioncondition includes at least one display condition selected from thegroup consisting of: a display condition in which no text input systemactivation target is visible, a display condition in which a text inputsystem activation target of a second size is visible, and a displaycondition in which a text input system activation target having a secondappearance characteristic is visible; (e) receiving a second user inputdirected to the text input system activation target in thepre-interaction condition; and (f) changing an appearance of the textinput system activation target from the pre-interaction condition to thefirst size and/or the first appearance characteristic in response to thesecond user input. The second size of the activation target, in at leastsome manner or dimension, may be smaller than the correspondingdimension(s) of the activation target at the first size. The secondappearance characteristic of the activation target, in at least someexamples, may be a plain text, faded, lightened, or grayed out versionof the activation target as compared with the activation target with thefirst appearance characteristic. The text input system activationtarget, in at least some examples of the invention, may be freelypositionable by the user, e.g., at any location along the window orscreen edges. After use of the text input system, it may be closed or“re-stowed” along the window or screen edge, at its location of lastuse, and in at least some examples of the invention, the text inputsystem will re-deploy for its next use in the same form, format, and/orstate in which it was last used. Still additional aspects of thisinvention relate to computer-readable media includingcomputer-executable instructions stored thereon for providing varioususer interfaces for activating and/or displaying a text input system,performing various text input system activating and/or displayingmethods, and/or operating various text input activation and/ordisplaying systems.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects, features, and advantages of the presentinvention will be more readily apparent and more fully understood fromthe following detailed description, taken in connection with theappended drawings, in which:

FIGS. 1A through 1C illustrate examples of activation of a text inputsystem in conventional pen-based computing systems;

FIG. 2 illustrates a schematic diagram of a general-purpose digitalcomputing environment in which certain aspects of the present inventionmay be implemented;

FIG. 3 illustrates a pen-based personal computing (PC) environment inwhich certain aspects of the present invention may be implemented;

FIGS. 4A through 4D illustrate various example features of activationtargets and text input systems and their use in accordance with examplesof this invention; and

FIGS. 5A through 5F illustrate various additional example features ofactivation targets and text input systems and their use in accordancewith examples of this invention.

DETAILED DESCRIPTION I. Terms

The following terms are used in this specification and, unless otherwisespecified or clear from the context, the terms have the meaningsprovided below:

“Ink” (also called “digital ink” or “electronic ink”)—A sequence or setof handwritten strokes. A sequence of strokes may include strokes in anordered form. The sequence may be ordered in any suitable manner, suchas by the time the stroke was captured and/or by where the strokeappears on a page. Other orders are possible. Electronic ink informationmay be stored in any desired manner, such as in an “ink serializedformat,” e.g., a format used for creating, storing, displaying, andmanipulating electronic ink data in the Microsoft® Windows XP Tablet PCEdition Version 2002 operating system and/or the Microsoft® WindowsJournal software application.

“Point”—Information defining a location in space. For example, a pointmay be defined relative to a capturing space (for example, points on adigitizer) and/or a display space (the points or pixels of a displaydevice). Points may be represented using a variety of known techniquesincluding two dimensional Cartesian coordinates (X, Y), polarcoordinates (r, Θ), three dimensional coordinates ((X, Y, Z), (r, Θ, ρ),(X, Y, t (where t is time)), (r, Θ, t)), four dimensional coordinates((X, Y, Z, t) and (r, Θ, ρ, t)), and other techniques as known in theart.

“Stroke”—A sequence or set of captured points. A stroke may bedetermined in a number of ways, for example, using time (e.g., a strokeis all points encountered by the stylus during a predetermined timeperiod or interval), using a predetermined number of points (e.g., astroke is all points 1 through X where X is predefined), or using styluscontact with the digitizer surface (e.g., a stroke is all pointsencountered by the stylus between a pen-down event and a pen-up event).When rendered, the sequence of points making up a stroke may beconnected with lines. Alternatively, a stroke may be represented as apoint and a vector pointing in the direction of the next point. Further,a stroke may be referred to as a simple list (or array or table) ofpoints. In short, a stroke is intended to encompass any representationof points or segments relating to ink, irrespective of the underlyingrepresentation of points and/or what connects the points.

“Pen”—Any type of user input device useful in entering electronic inkinto and/or otherwise manipulating or controlling an electronic documentand/or a computer operating system. The terms “pen” and “stylus” may beused interchangeably in this specification.

“Pen-Down Event”—An event that is initiated at the time a pen contacts adigitizer. Typically, a pen-down event will end at the time the penleaves the digitizer surface (also called a “pen-up event” in thisspecification).

“Hover”—Positioning or locating a pen proximate or adjacent to adigitizer surface but not in contact with the surface, irrespective ofwhether the pen is moving. No specific time period or cessation ofmotion at a particular location or position is necessary for an actionto constitute a “hover” action. For example, a “hover” may occur duringthe time period that a user continuously moves a pen toward and intocontact with a digitizer surface. A “hover” action also may constituteplacement of a pointing device (such as a mouse's pointer) at a specificlocation in a display without “clicking” one of the mouse's buttons.

“Render” or “Rendered” or “Rendering”—The process of determining howgraphics (and/or ink) are to be displayed, whether on a screen, printed,or output in some other manner.

“Computer-Readable Medium”—any available media that can be accessed by auser on a computer system. By way of example, and not limitation,“computer-readable media” may include computer storage media andcommunication media. “Computer storage media” includes volatile andnonvolatile, removable and non-removable media implemented in any methodor technology for storage of information, such as computer-readableinstructions, data structures, program modules or other data. “Computerstorage media” includes, but is not limited to, RAM, ROM, EEPROM, flashmemory or other memory technology; CD-ROM, digital versatile disks (DVD)or other optical storage devices; magnetic cassettes, magnetic tape,magnetic disk storage or other magnetic storage devices; or any othermedium that can be used to store the desired information and that can beaccessed by a computer. “Communication media” typically embodiescomputer-readable instructions, data structures, program modules orother data in a modulated data signal, such as a carrier wave or othertransport mechanism, and includes any information delivery media. Theterm “modulated data signal” means a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, and not limitation, communicationmedia includes wired media, such as a wired network or direct-wiredconnection, and wireless media, such as acoustic, RF, infrared and otherwireless media. Combinations of any of the above should also be includedwithin the scope of “computer-readable media.”

II. Example Operating Environment

FIG. 2 illustrates a schematic diagram of a general-purpose digitalcomputing environment that can be used to implement various aspects ofthe present invention. In FIG. 2, a computer 100 includes a processingunit 110, a system memory 120, and a system bus 130 that couples varioussystem components including the system memory 120 to the processing unit110. The system bus 130 may be any of several types of bus structuresincluding a memory bus or memory controller, a peripheral bus, and alocal bus using any of a variety of bus architectures. The system memory120 may include read only memory (ROM) 140 and random access memory(RAM) 150.

A basic input/output system 160 (BIOS), contains the basic routines thathelp to transfer information between elements within the computer 100,such as during start-up, is stored in the ROM 140. The computer 100 alsomay include a hard disk drive 170 for reading from and writing to a harddisk (not shown), a magnetic disk drive 180 for reading from or writingto a removable magnetic disk 190, and an optical disk drive 191 forreading from or writing to a removable optical disk 199, such as a CDROM or other optical media. The hard disk drive 170, magnetic disk drive180, and optical disk drive 191 are connected to the system bus 130 by ahard disk drive interface 192, a magnetic disk drive interface 193, andan optical disk drive interface 194, respectively. These drives andtheir associated computer-readable media provide nonvolatile storage ofcomputer-readable instructions, data structures, program modules, andother data for the personal computer 100. It will be appreciated bythose skilled in the art that other types of computer-readable mediathat can store data that is accessible by a computer, such as magneticcassettes, flash memory cards, digital video disks, Bernoullicartridges, random access memories (RAMs), read only memories (ROMs),and the like, may also be used in the example operating environment.

A number of program modules can be stored on the hard disk drive 170,magnetic disk 190, optical disk 199, ROM 140, or RAM 150, including anoperating system 195, one or more application programs 196, otherprogram modules 197, and program data 198. A user can enter commands andinformation into the computer 100 through input devices, such as akeyboard 101 and pointing device 102 (such as a mouse). Other inputdevices (not shown) may include a microphone, joystick, game pad,satellite dish, scanner, or the like. These and other input devices areoften connected to the processing unit 110 through a serial portinterface 106 that is coupled to the system bus 130, but they also maybe connected by other interfaces, such as a parallel port, game port, ora universal serial bus (USB), and the like. Further still, these devicesmay be coupled directly to the system bus 130 via an appropriateinterface (not shown).

A monitor 107 or other type of display device also may be connected tothe system bus 130 via an interface, such as a video adapter 108. Inaddition to the monitor 107, personal computers typically include otherperipheral output devices (not shown), such as speakers and printers. Inone example, a pen digitizer 165 and accompanying pen or stylus 166 areprovided in order to digitally capture freehand input. Although aconnection between the pen digitizer 165 and the serial port interface106 is shown in FIG. 2, in practice, the pen digitizer 165 may bedirectly coupled to the processing unit 110, or it may be coupled to theprocessing unit 110 in any suitable manner, such as via a parallel portor another interface and the system bus 130 as is known in the art.Furthermore, although the digitizer 165 is shown apart from the monitor107 in FIG. 2, the usable input area of the digitizer 165 may beco-extensive with the display area of the monitor 107. Further still,the digitizer 165 may be integrated in the monitor 107, or it may existas a separate device overlaying or otherwise appended to the monitor107.

The computer 100 can operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer109. The remote computer 109 can be a server, a router, a network PC, apeer device or other common network node, and it typically includes manyor all of the elements described above relative to the computer 100,although for simplicity, only a memory storage device 111 has beenillustrated in FIG. 2. The logical connections depicted in FIG. 2include a local area network (LAN) 112 and a wide area network (WAN)113. Such networking environments are commonplace in offices,enterprise-wide computer networks, intranets, and the Internet, usingboth wired and wireless connections.

When used in a LAN networking environment, the computer 100 is connectedto the local area network 112 through a network interface or adapter114. When used in a WAN networking environment, the personal computer100 typically includes a modem 115 or other means for establishing acommunications link over the wide area network 113, such as theInternet. The modem 115, which may be internal or external to thecomputer 100, may be connected to the system bus 130 via the serial portinterface 106. In a networked environment, program modules depictedrelative to the personal computer 100, or portions thereof, may bestored in the remote memory storage device.

It will be appreciated that the network connections shown are examplesand other techniques for establishing a communications link between thecomputers can be used. The existence of any of various well-knownprotocols such as TCP/IP, Ethernet, FTP, HTTP, UDP, and the like ispresumed, and the system can be operated in a user-server configurationto permit a user to retrieve web pages from a web-based server. Any ofvarious conventional web browsers can be used to display and manipulatedata on web pages.

Although the FIG. 2 environment shows an exemplary environment, it willbe understood that other computing environments also may be used. Forexample, one or more examples of the present invention may use anenvironment having fewer than all of the various aspects shown in FIG. 2and described above, and these aspects may appear in variouscombinations and subcombinations that will be apparent to one ofordinary skill.

FIG. 3 illustrates a pen-based personal computer (PC) 201 that can beused in accordance with various aspects of the present invention. Any orall of the features, subsystems, and functions in the system of FIG. 2can be included in the computer of FIG. 3. The pen-based personalcomputer system 201 includes a large display surface 202, e.g., adigitizing flat panel display, such as a liquid crystal display (LCD)screen, on which a plurality of panels 203 is displayed. Using stylus204, a user can select, highlight, and write on the digitizing displayarea. Examples of suitable digitizing display panels includeelectromagnetic pen digitizers, such as pen digitizers available fromMutoh Co. (now known as FinePoint Innovations Co.) or Wacom TechnologyCo. Other types of pen digitizers, e.g., optical digitizers, andtouch-sensitive digitizers may also be used. The pen-based computingsystem 201 interprets gestures made using stylus 204 in order tomanipulate data, enter text, and execute conventional computerapplication tasks, such as creating, editing, and modifyingspreadsheets, word processing programs, and the like.

The stylus 204 may be equipped with buttons or other features to augmentits capabilities. In one example, a stylus 204 could be implemented as a“pencil” or “pen”, in which one end constitutes a writing portion andthe other end constitutes an “eraser” end, and which, when moved acrossthe display, indicates portions of electronic ink on the display thatare to be erased. Other types of input devices, such as a mouse,trackball, keyboard, or the like also could be used. Additionally, auser's own finger could be used for selecting or indicating portions ofthe displayed image on a touch-sensitive or proximity-sensitive display.Consequently, the term “user input device,” as used herein, is intendedto have a broad definition and encompasses many variations on well-knowninput devices.

In various examples, the system provides an ink platform as a set of COM(component object model) services that an application program can use tocapture, manipulate, and store ink. The ink platform also may include amark-up language including a language like the extensible markuplanguage (XML). Further, the system may use DCOM as anotherimplementation. Yet further implementations may be used including theWin32 programming model and the .Net programming model from MicrosoftCorporation. These platforms are commercially available and known in theart.

In addition to use with full performance pen-based computing systems or“tablet PCs” (e.g., convertible laptops or “slate” type tablet PCs),aspects of this invention can be used in conjunction with other types ofpen-based computing systems and/or other devices that accept data aselectronic ink and/or accept electronic pen or stylus input, such as:hand-held or palm-top computing systems; personal digital assistants;pocket personal computers; mobile and cellular telephones, pagers, andother communication devices; watches; appliances; and any other devicesor systems that include a monitor or other display device and/or adigitizer that presents printed or graphical information to users and/orallows input using an electronic pen or stylus, or which can processelectronic ink collected by another device (e.g., a conventional desktopcomputer that can process electronic ink collected by a tablet PC).

The invention now will be described in conjunction with the remainingfigures, which illustrate various examples of the invention andinformation to help explain the invention. The specific figures andinformation contained in this detailed description should not beconstrued as limiting the invention.

III. General Overview of the Invention

As mentioned above, aspects of this invention relate to user interfaces,methods, systems, and computer-readable media for activating and/ordisplaying a text input system on a display device, such as on a displayof a pen-based computing system. User interfaces in accordance with atleast some examples of this invention may include: (a) a first displaymode displaying a text input system activation target at a first sizeand/or with a first appearance characteristic, wherein the first displaymode is displayed at least when a user input device hovers proximate toa location of the text input system activation target, wherein thelocation of the text input system activation target on the displaydevice is selectable based on user input; and (b) a second display modedisplaying the text input system, wherein the second display mode isactivated at least when a user interacts in a predetermined manner withthe text input system activation target in the first display mode (e.g.,by tapping the target, by hovering over it, by hovering over it for anextended time period, etc.). The activation target may be freelypositionable by the user along an edge of the panel, window, or screen,e.g., by a user “drag” operation or other desired manner. Userinterfaces in accordance with at least some examples of this inventionfurther may include a third display mode displaying a pre-interactioncondition of the text input system activation target, wherein thepre-interaction condition includes at least one display conditionselected from the group consisting of: a display condition in which notext input system activation target is visible, a display condition inwhich a text input system activation target of a second, smaller size isvisible, and a display condition in which a text input system activationtarget with a second appearance characteristic is visible, wherein thethird display mode is displayed at least when no user input device ofthe activation target is sensed by a digitizer associated with thedisplay device (and in some instances, whenever no hover action near thelocation of the activation target is sensed). The change between thethird and first display modes may occur, for example, when a user inputdevice hovers proximate to the text input system activation target inthe pre-interaction condition (e.g., this hover action may change thetext input system activation target from a smaller size to a largersize, and/or from a plain text, faded, lightened, unhighlighted, orblack-and-white version to a full color, bolded, underlined, italicized,animated and/or other more vibrant or visible condition), to therebymake it easier for the user to see and/or interact with the text inputsystem activation target. Once activated, the second “display mode” maydisplay the text input system in a floating manner above other displayareas visible on the display device.

Methods for activating and/or displaying text input systems on displaydevices in accordance with at least some examples of this invention mayinclude: (a) displaying a text input system activation target at a firstlocation on the display device, wherein the text input system activationtarget is displayed at a first size and/or with a first appearancecharacteristic at least when a user input device hovers proximate to thefirst location, wherein the first location is changeable based on userinput; (b) receiving a first user input directed to the text inputsystem activation target (e.g., a tap, a hover action, an extended hoveraction, etc.); and (c) activating a text input system in response to thefirst user input. Such methods further may include: (d) displaying apre-interaction condition of the text input system activation target,wherein the pre-interaction condition includes at least one displaycondition selected from the group consisting of: a display condition inwhich no text input system activation target is visible, a displaycondition in which a text input system activation target of a secondsize is visible, and a display condition in which a text input systemactivation target of a second appearance characteristic is visible; (e)receiving a second user input directed to the text input systemactivation target in the pre-interaction condition; and (f) changing anappearance of the text input system activation target from thepre-interaction condition to the first size and/or the first appearancecharacteristic (e.g., changing from the second size to the first sizeand/or changing from the second appearance characteristic to the firstappearance characteristic) in response to the second user input. In atleast some examples of this invention, the second user input (i.e., tochange the activation target from the pre-interaction condition to thefirst size and/or the first appearance characteristic in the aboveexample) may constitute a user input device hover action proximate tothe first location. Additionally or alternatively, in at least someexamples of the invention, the first user input described above (i.e.,the input that activates the text input system in this example) mayconstitute a user input device “tap” or “click” of the text input systemactivation target. Additionally, in at least some examples of thisinvention, the pre-interaction condition of the text input systemactivation target may be displayed at least when a user input device isnot sensed by a digitizer associated with the display device, and/or theappearance of the text input system activation target may be changedfrom the pre-interaction condition to the first size and/or the firstappearance characteristic at least when a user input device hoversproximate to the text input system activation target in thepre-interaction condition.

Systems for activating and/or displaying text input systems inaccordance with examples of this invention may include: (a) a displaydevice (such as a computer display); and (b) a processor system (e.g., acomputer processor) programmed and adapted to: (i) display a text inputsystem activation target at a first location on the display device,wherein the text input system activation target is displayed at a firstsize and/or with a first appearance characteristic at least when a userinput device hovers proximate to the first location, wherein the firstlocation is changeable based on user input; (ii) recognize a first userinput directed to the text input system activation target; and (iii)activate the text input system in response to the first user input.Systems in accordance with at least some examples of this inventionfurther may include an input system, such as a system for receivingmouse or electronic ink input (e.g., a digitizer screen, etc.).Processor systems used in at least some example systems according tothis invention further may be programmed and adapted to: (iv) display apre-interaction condition of the text input system activation target,wherein the pre-interaction condition includes at least one displaycondition selected from the group consisting of: a display condition inwhich no text input system activation target is visible, a displaycondition in which a text input system activation target of a secondsize is visible, and a display condition in which a text input systemactivation target having a second appearance characteristic is visible;(v) recognize a second user input directed to the text input systemactivation target in the pre-interaction condition; and (vi) change anappearance of the text input system activation target from thepre-interaction condition to the first size and/or the first appearancecharacteristic (e.g., from the second size and/or second appearancecharacteristic) in response to the second user input. As describedabove, in at least some example systems, the second user input (i.e., tochange the activation target from the pre-interaction condition to thefirst size and/or the first appearance characteristic in the aboveexample) may constitute a user input device hover action proximate tothe first location, and/or the first user input described above (i.e.,the input that activates the text input system) may constitute a userinput device “tap” or “click” of the text input system activationtarget. Additionally, in at least some examples of this invention, theprocessor system may be programmed and adapted to display the text inputsystem activation target in the pre-interaction condition when a userinput device is not sensed by a digitizer, and/or the appearance of thetext input system activation target may be changed from thepre-interaction condition to the first size and/or the first appearancecharacteristic at least when a user input device hovers proximate to thetext input system activation target in the pre-interaction condition.

In at least some examples of the invention, the text input systemactivation target will not be visible (or will be very small) at timeswhen no pen or stylus is sensed by the digitizer. Then, when thepresence of a pen or stylus is sensed by the digitizer, e.g., as a hoveraction, at any location on the digitizer, the activation target then maybe made to appear (or optionally, may change its appearance somewhat, ifit was already visible). In response to a hover action in closeproximity to the activation target's location, the activation targetthen may expand to its larger size (or otherwise change its appearancecharacteristics), to make it easier to interact with the activationtarget (e.g., with a pen tap), and thereby fully deploy the target.

Additional aspects of this invention relate to computer-readable mediaincluding computer-executable instructions stored thereon for providingvarious user interfaces for activating and/or displaying a text inputsystem, performing various text input system activating and/ordisplaying methods, and/or operating various text input activationand/or displaying systems, including the various user interfaces,systems, and methods described above (and those interfaces, systems, andmethods described in more detail below).

IV. Specific Examples of the Invention

As mentioned above, this invention relates to user interfaces, methods,systems, and computer-readable media for activating and/or displaying atext input system on a display device. Some more specific aspects ofthis invention seek to make location and/or interaction with activationtargets for text input systems in pen-based computing systems morenatural, convenient, and customizable for users. In at least someexamples of the invention, the activation targets for the text inputsystems will be relatively small in size (at least under someconditions), yet readily visible and located for easy interaction anduse by computer users.

FIGS. 4A through 4D generally illustrate an example of a user interfacefor activating and/or displaying a text input system on a display device400, such as on a display device 400 of a pen-based computing system(which may include an associated digitizer, as described above). FIG. 4Aillustrates an example text input system activation target (or icon) 402used to activate the text input system according to examples of thisinvention in a “pre-interaction”state. The “pre-interaction” state 402of the text input system activation target of this example is a“collapsed” (or smaller sized) state. As will be described in moredetail below, user interaction with the target 402 in thepre-interaction state or condition will cause the target to expand to alarger size in this example system and method.

The “pre-interaction” state of text input system activation target 402may exist at various times while an application program and/or anoverall computer operating system is running. For example, the textinput system activation target 402 may be present in its pre-interactionstate as a default state, e.g., whenever the application program and/oroperating system is running and the user input device (such as anelectronic pen or stylus 404) is not interacting with the text inputsystem activation target 402 and/or hovering at, near, or over alocation of the text input system activation target 402 (e.g., within afew inches of text input system activation target 402). Thepre-interaction state of text input system activation target 402 may bea “collapsed” state in which the target 402 appears relatively small ornarrow, e.g., at a width or height that would make it somewhat difficultfor a user to directly and reliably engage with the activation target402, such as 4-5 pixels wide, or even less. While narrow, however, thecollapsed state of the activation target 402 in this example remainsreadily visible, and its location (e.g., along the side of the displaydevice and/or along a side edge of an active display portion or panelwith focus, e.g., where the user is working) readily reminds the user ofthe text input system's presence and availability.

As is known in the pen-based computing system art, at least someelectronic pens or styli 404 may be detectable by a digitizer or otherportion of the pen-based computing system when the pen or stylus 404 islocated relatively close or adjacent to the digitizer surface (thedigitizer surface may coincide with and/or be located adjacent thedisplay screen, such as the screen of display device 400). For example,some pens or styli 404 are “active,” which in this specification meansthat they transmit, reflect, alter, or otherwise modify energy, data, orother information transmitted, sensed, and/or detectable by a digitizerwhen the pens or styli 404 are located within a certain range of thedigitizer surface. As more specific examples, some pens or styli 404 mayinclude circuitry or other structures that receive energy emitted by thedigitizer and/or alter magnetic or electronic fields transmitted byand/or sensed by the digitizer, such that the presence of the pens orstyli 404 can be sensed by the digitizer due to changes in detectedmagnetic or electric fields (e.g., at least when the pens or styli areclose to the digitizer surface). As other examples, some pens or styli404 may transmit or reflect data, electrical or magnetic fields, orother energy or information that are detectable by the digitizer (atleast when located in proximity thereto). Any suitable or desired way ofsensing or detecting the presence of a pen or stylus 404 (or other userinput device) when it is located near a display device screen 400(including sensing or detecting the presence of “inactive” user inputdevices) may be used in accordance with this invention. Although astylus 404 and digitizer combination may be designed to allow detectionof a stylus 404 at virtually any reasonable position with respect to thedigitizer surface 400, in at least some conventional pen-based computingsystems, the stylus 404 will be initially detectable when it is aboutone-half to two inches from the digitizer surface 400, and in someexamples, when it is approximately a half inch to an inch from thedigitizer surface 400. Of course, aspects of this invention may bepractice both with “active” pens or other input devices, as well as withinactive input devices, including with touch screen systems.

Hovering a pen or stylus 404 at or near a location of thepre-interaction activation target 402 (e.g., within about two inches orless) in this example of the invention will change the appearance of theactivation target from its pre-interaction state 402 (an example ofwhich is shown in FIG. 4A) to its post-interaction state (e.g., to anexpanded or enlarged state 402 a, as shown in FIG. 4B). In its expandedstate 402 a, the activation target is enlarged and readily tapable,e.g., by the electronic pen 404, which, as noted above, had beenhovering near the activation target to change it from its collapsedstate 402 to its expanded state 402 a. The size and/or appearance of theactivation target may change in any suitable or desired manner from thepre-interaction state to the post-interaction state without departingfrom the invention. For example, in its pre-interaction state 402, theactivation target may be narrower and/or shorter than the activationtarget in its post-interaction state (e.g., where it may be in anexpanded or enlarged state 402 a). As another example, in itspre-interaction state 402, the activation target may be “grayed out,”faded, lightened, in plain text, and/or otherwise (e.g., visually oraudibly) indicated as “inactive,” and it may change to an “active” state(e.g., in full color, underlined, bolded, italicized, highlighted,animated, and/or otherwise (visually or audibly) indicated as active)when the pen 404 is located nearby, e.g., when the pen 404 is detectedin a hover position near target 402 (optionally, with or without aphysical size change of the icon 402). Of course, any way of changingthe activation target 402 from an inactive to an active state (and viceversa) and/or any way of informing the user of this state change may beused without departing from this invention.

Further user interaction with and/or input directed to the expanded (orpost-interaction) activation target 402 a may be used to activate and/ordisplay a text input system, such as the various types of text inputsystems described above in conjunction with FIGS. 1B and 1C (e.g., ahandwriting input panel, a soft keyboard, or the like). For example, asshown in FIG. 4B, movement of the pen 404 from its hover position(position “A”) to a position where it temporarily contacts the digitizerand/or display surface 400 at or near the location of the expandedactivation target 402 a (e.g., position “B” where the pen 404 tip “taps”the display surface 400 at or near the location of the expandedactivation target 402 a) will activate the text input system and causeit to be displayed in this example structure. For example, as shown inFIG. 4C, this “tapping” action may cause a soft keyboard 410 (or anydesired type of text input system) to be displayed. While the text inputsystem (e.g., soft keyboard 410) may be displayed in any desired mannerwithout departing from this invention, in this illustrated example,tapping the activation target in its expanded state 402 a will initiatean animation in which it appears that the soft keyboard 410 (or othertext input system) scrolls out from the left side of the display screen400 in the direction of arrow 412 at the initial height at which theexpanded activation target 402 a was located. This animation orscrolling action associates and reinforces the purpose and function ofactivation targets 402 and/or 402 a in the user's mind, and thecontinued presence of the activation target 402 a at the far right sideof the displayed soft keyboard 410 during the scrolling or animationaction further associates and reinforces the purpose and function ofactivation target 402 a in the user's mind. Of course, if desired, theactivation target 402 a need not appear while the text input system isdeploying.

FIG. 4D illustrates an example of display device 400 with the text inputsystem (e.g., soft keyboard 410) fully deployed. As shown, in thisillustrated example, the soft keyboard 410 (or other text input system)remains displayed at the initial height of the expanded activationtarget 402 a and centered within the display portion, and the continuedpresence of the activation target 402 a at the far right side of thedisplayed soft keyboard 410 further associates and reinforces thepurpose and function of activation target 402 a in the user's mind. Ofcourse, if desired, the activation target 402 a need not remaindisplayed with the fully deployed text input system.

If desired, the user may change the size and/or location of the softkeyboard 410 (or other text input system). For example, in at least someexample user interfaces, systems, and methods according to thisinvention, a user may readily change the location of the text inputsystem by setting the pen tip down in a border 416 of the input systemand dragging the text input system to the new, desired location beforethe pen tip is lifted from the display device surface 400. As anotherexample, if desired, the size of the text input system may be adjustedby setting the pen tip down at an edge or boundary of the system (e.g.,edge 418) and dragging the edge to the desired new size. Any edge orcorner of the boundary may be used for size adjustment, as is known inthe art. Users also may control the location at which the text inputsystem stops scrolling across the screen (such that it will notnecessary always center in the open panel in which it is activated), ifdesired. Such size and location changing techniques are known and usedin the art.

In at least some example user interfaces, systems, and methods accordingto the invention, the text input system will remain visible andavailable until positively closed by the user. Optionally, if desired,systems and methods according to at least some examples of the inventionmay automatically close the text input system after a certain amount oftime of non-use. In any event, the text input system can be re-stowed inany suitable or desired manner without departing from the invention. Forexample, the user could indicate that he/she has finished using the textinput system by tapping the pen in the system's “close” icon 414, byagain tapping the expanded activation target 402 a, by hovering over theactivation target 402 a located at the edge of the text input system,and/or in any other desired manner. The text input system may disappearin any desired manner, such as by simply disappearing or fading away, byscrolling back to the left side of the display 400 (opposite thescrolling animation described above in connection with FIGS. 4B and 4C),using some other animation procedure, or the like. In at least someexamples of the invention, once the text input system is closed, thedisplay 400 will return to the state shown in FIG. 4A with theactivation target in its collapsed or other pre-interaction state 402.Optionally, if desired, after the text input system is closed, thesystem could return the display 400 to the state shown in FIG. 4B for ashort time (with the expanded activation target 402 a displayed), andthen finally return to the collapsed state 402 shown in FIG. 4A if thereis no user interaction with the expanded activation target 402 a withina predetermined time period and/or if the user undertakes other actionaway from animation target 402 a. Of course, many variations in themanner and/or appearance of the display 400 and/or activation targets402 and/or 402 a may be used without departing from this invention.

After use and/or closure of the text input system, systems and methodsaccording to the invention may return and/or display the activationtargets 402 and/or 402 a at any desired location without departing fromthe invention. For example, in some user interfaces, systems, andmethods, the text input system will return and/or the system willdisplay the activation targets 402 and/or 402 a at the same side of thedisplay screen 400 from which it was originally activated and at theheight along the display 400 side where the text input system was lastlocated and/or used (e.g., at the same height it originally deployed orat a different height, if the user changed the location of the textinput system during use). As another example, if desired, at least someuser interfaces, systems, and methods may return the text input systemand/or display the activation targets 402 and/or 402 a at the same sidefrom which it was originally activated and at the same height at whichthe activation targets 402 and/or 402 a were previously displayed. Othercombinations of text input system return and/or new activation targetdisplay locations may be used without departing from this invention.

As another alternative and/or as an additional feature, rather thanand/or in addition to tapping the activation target 402 a with the pentip to activate the text input system, the system may be activatedwhen/if an extended hover action over the activation target 402 a (e.g.,for more than a predetermined time period) is detected. Also, ifdesired, in at least some example systems and methods according to theinvention, moving the pen 404 away from the digitizer/display screen 400without tapping the activation target 402 a, tapping a location otherthan the activation target 402 a, and/or moving the pen to hover at alocation away from the activation target 402 a without tapping it, andthe like, may be detected by the systems and methods and used toinitiate a change in the activation target from its expanded orpost-interaction state 402 a (as shown in FIG. 4B) back to its collapsedor pre-interaction state (as shown in FIG. 4A) without activation of thetext input system. In at least some examples of the invention, anextended hover action over the expanded activation target 402 a also maybe detected and used to initiate a change in the activation target fromits post-interaction state 402 a back to its pre-interaction statewithout activation of the text input system, e.g., if the hover lastslonger than a predetermined time period.

FIGS. 5A through 5F illustrate examples of various additional featuresthat may be available in accordance with at least some examples of theinvention that make the text input system and its activation targetsmore versatile, customizable, and user friendly. For example, as shownin these figures, the location of the activation targets 402 and/or 402a may be freely selected by the user, e.g., based on his or her workpreferences and/or individual needs or desires. As shown in FIG. 5A, theactivation target 402 a (and hence the target in its pre-interactionstate 402) may be freely changed along the left edge of the displayand/or active panel (as illustrated by arrow 500). While movement of theactivation target 402 a may be accomplished in any desired mannerwithout departing from the invention, in at least some examples, theactivation targets 402 and/or 402 a may be freely moved along thedisplay or active panel edge by setting the pen 404 tip down within theactivation target 402 a (shown in broken lines and grayed in FIG. 5A)and dragging the target 402 a to the new, desired height or location(shown in solid and black lines), using the pen 404, before the pen 404tip is lifted from the display device surface 400. As one more specificexample, movement of the pen 404 tip more than a predetermined distance(e.g., more than 5 pixels) during a pen-down event within the boundariesof the activation target 402 a may be sufficient to initiate this targetmovement action (e.g., movement of the pen 404 a distance longer thanthat observed during a typical pen “tap” may be used to distinguish thedesire to enter the activation target movement mode from the desire tosimply activate the text input system by tapping the target 402 a). Asanother example, if desired, a pen-down event within the boundaries ofthe activation target 402 a may be required to last more than apredetermined time period in order to activate the target movementprocedure (e.g., a “press-and-hold” action of the pen within the target402 a boundaries to produce a pen-down time longer than a typical pendown time during a tap may be used to distinguish the desire to enterthe activation target movement mode from the desire to activate the textinput system by tapping the target). As still additional examples, ifdesired, a user could activate an activation target movement mode from amenu, such as from a toolbar menu; by highlighting the target and thenmoving it with the pen, mouse, or keyboard; etc.

Due to typical pen 404 holding angles and the like, right-handed penusers typically prefer locating the activation targets 402 and/or 402 asomewhere along the left hand side of the display 400 or the activedisplay portion (e.g., the portion of the display 400 having focusand/or accepting user input if several programs or display panels areopen). Left-handed pen users, on the other hand, typically preferlocating the activation target 402 a along the right hand side of thedisplay device 400 or the active display portion. Therefore, activationtargets 402 and/or 402 a in accordance with at least some examples ofthis invention also may be freely locatable along the right hand side ofthe display device 400 or the active display portion, as illustrated byarrow 500 in FIG. 5B. If desired, the activation targets 402 and/or 402a may be freely movable from one side of the display screen 400 to theother, e.g., by the pen dragging action described above and dragging thetarget 402 a to the opposite lateral side of the display 400. As a morespecific example, if a user drags the target 402 a more than apredetermined widthwise distance across the display screen 400 (e.g.,more than halfway across), this action may be used to trigger systemsand methods according to examples of this invention to place and/ordisplay the activation target 402 a on the other side of the displayscreen 400. As still another example, if desired, by detecting aspecific user's pen angle or tilt at a given time, systems and methodsaccording to at least some examples of the invention may determinewhether the user is holding the pen in his/her right or left hand, andthe systems and methods may locate the activation targets 402 and 402 aalong the left or right edges of the display screen 400 based on thisdetermination, e.g., to the left side for right handed users and to theright side for left-handed users (while optionally giving the user anopportunity to override this automatic selection). Of course, other waysof moving and/or locating the activation targets 402 and/or 402 a may beused without departing from the invention. The text input system mayscroll out from the right hand side of display screen 400 and/orotherwise be activated in a manner similar to that described above inconjunction with FIGS. 4A through 4D. Of course, any activationanimation, appearance, and/or features may be used without departingfrom this invention.

Activation target 402 and/or 402 a locations are not limited to thelateral sides of a display device 400. Rather, as shown in FIGS. 5C and5D, activation targets 402 and/or 402 a also may be located along thebottom and/or top edges of a display device 400 and/or along the bottomand/or top edges of an active display portion or open panel of a displaydevice 400. As with the side located targets 402 and/or 402 a, thelocations of the activation targets 402 and/or 402 a may be freelyselected by the user, e.g., using a pen touch and drag action or otherdesired action, as described above in conjunction with FIG. 5A and asindicated by arrow 500 in FIGS. 5C and 5D.

When placing the activation target 402 and/or 402 a along the bottomedge of the display screen 400, in order to prevent the text inputsystem from deploying all or partially off the visible screen displayarea, systems and methods according to at least some examples of thisinvention will not permit the activation target 402 and/or 402 a to bedragged to a vertical position below the lowest position where floatingcan be achieved. If the user continues to drag the activation target 402and/or 402 a below this level, then the target of this example will snapto the bottom level (e.g., and optionally change its appearance to theappearance and/or orientation shown in FIG. 5C). Optionally, the textinput system may default to operation in a docked mode when the targets402 and/or 402 a are placed along this edge, as will be described inmore detail below. Similar actions may result, for example, whenactivation targets 402 and/or 402 a are dragged to locations higher thana predetermined height along a lateral side edge, e.g., as shown in FIG.5D.

FIGS. 5D through 5F illustrate an example deployment of a text inputsystem from user interaction with activation targets 402 and/or 402 alocated at the top of a display screen 400. When a user interacts withthe text input system activation target 402 a, as shown in FIG. 5D(e.g., by “tapping” on the activation target 402 a with the pen 404,hovering over it with the pen 404 for longer than a predetermined timeperiod, etc.), this action will launch or activate the text input systemand cause it to deploy. FIG. 5E illustrates an example of a text inputsystem 410 (in the form of a soft keyboard in this example), as it isbeing deployed. While the text input system 410 may be displayed in anydesired manner without departing from this invention, in thisillustrated example, tapping the activation target 402 a in its expandedstate (as shown in FIG. 5D) will initiate an animation in which itappears that the text input system 410 scrolls down from the top of thedisplay screen 400 in the direction of arrow 520. Again, this animationor scrolling action associates and reinforces the purpose and functionof activation target 402 a in the user's mind, and the continuedpresence of the activation target 402 a at the bottom of the text inputsystem 410 during the scrolling or animation further associates andreinforces the purpose and function of activation target 402 a in theuser's mind. Of course, if desired, the activation target 402 a need notappear during this deployment procedure.

FIG. 5F illustrates an example of display device 400 with the text inputsystem 410 of this example fully deployed. As shown, in this illustratedexample, the text input system 410 is fully displayed and is availablefor data input (e.g., using an electronic pen or other suitable inputdevice). Of course, any type of text input system may be used withoutdeparting from this invention. Additionally, the continued presence ofthe activation target 402 a at the bottom of the displayed text inputsystem 410 further associates and reinforces the purpose and function ofactivation target 402 a in the user's mind. If desired, however, theactivation target 402 a need not be visible when the input system 410 isfully deployed. If desired, the user may change the size and/or locationof the text input system 410, e.g., using pen dragging techniques orother techniques, as generally described above in conjunction with FIG.4D, including through the use of size and location changing techniquesthat are known and used in the art.

When the user has finished using the text input system (or at any otherappropriate or desired time), the system can be re-stowed in anysuitable or desired manner without departing from the invention. Forexample, the user could indicate that he/she has finished using the textinput system by tapping the pen in the system's “close” icon 414, byagain tapping the expanded activation target 402 a, and/or in any otherdesired manner. The text input system 410 may disappear in any desiredmanner, such as by simply disappearing or fading away, by scrolling backinto the top of the display 400 (opposite the scrolling described abovein connection with FIGS. 5D through 5F), through some other animationtechnique, or the like. Scrolling backward, as described above, can helpfurther reinforce the presence and use of the activation targets 402and/or 402 a in the user's mind. In at least some examples of theinvention, once the text input system 410 is closed, the display 400will return to the state shown in FIG. 5D or to a state with theactivation target in a collapsed or other pre-interaction state (e.g.,like state 402 described above). Optionally, if desired, after the textinput system 410 is closed, the system could return the display 400 tothe state shown in FIG. 5D for a time (with the expanded activationtarget 402 a displayed), and then finally return to the collapsed stateas described above, e.g., if there is no user interaction with theexpanded activation target 402 a within a predetermined time periodand/or if a user takes other action away from the activation target 402a. Of course, many variations in the manner and/or appearance of thedisplay and/or activation target may be used without departing from thisinvention.

The manner in which text input systems deploy also may vary (andoptionally may be controlled by the system user) in systems and/ormethods in accordance with this invention. If desired, users will beable to freely select the active “modes” of operation, which aredescribed in more detail below. FIGS. 4A through 4D illustrate anexample of systems and methods in which the text input system deploys ina “floating manner.” In this manner or mode of operation, the text inputsystem appears and acts as if it is essentially floating on top of allother display portions or panels and/or all other open applications. Inat least some examples, in this floating manner, the text input systemdoes not reserve and/or take up space in the open display portion and/orthe portion of the display having focus. Also, if desired, whenactivated in this floating manner, the text input system will remain inplace in a floating manner until it is stowed or its mode of operationis changed. For example, even if the user and/or the system changes theactive application program and/or display portion being used, changesfocus, or the like, the text input system in this mode will remain ontop and available for use. Of course, the manner in which the text inputsystem operates in this floating mode may vary widely without departingfrom the invention.

FIGS. 5D through 5F illustrate an example of systems and methods inwhich the text input system deploys in a “docked manner.” In this manneror mode of operation, the text input system, when launched, reservesspace on the screen for itself. Therefore, when the text input systemactivated, as evident from a comparison of FIG. 5D with FIGS. 5E and 5F,some data originally present on the display screen 400 no longer appearsonce the text input system is activated (e.g., the display area for theapplication program becomes smaller and less information is displayed inthis example). Alternatively, if desired, as described above inconjunction with FIGS. 1A through 1C, in this “docked” mode, the textinput system may reserve space on the display screen for itself and theinformation originally present on the screen when the text input systemwas launched may be displayed in a smaller size so that all (orsubstantially all) of the originally displayed data can remain displayedeven when the text input system is being utilized. In this “docked”manner of operation, in at least some examples, the text input systemwill remain at the set location on the screen (optionally movable by theuser), regardless of whether the user and/or system changes the activeapplication program and/or display portion or panel being used, infocus, or the like. While the “docked” manner of operation may be usedat any desired location on the display screen, generally this manner ofoperation is better suited for use when the text input system isoriented to deploy from and/or at the top or bottom edges of the displayscreen. If desired, systems and methods in accordance with at least someexamples of this invention may automatically default to the “docked”mode of operation any time the text input system activation targets areplaced in the top and/or bottom edges of the screen (optionally, a usermay override this default selection and/or place the system in adifferent operating mode, without departing from the invention). Manyvariations in the operating characteristics of systems and methods ofthe invention is this “docked” mode are possible without departing fromthis invention.

As another option, the text input system may be arranged or designatedto deploy in an “in-place” manner. In this operational mode, inaccordance with at least some examples of this invention, the text inputsystem will tie itself to a particular open field, display panel, orregion (e.g., an active display panel and/or one having focus). In thisexample operating mode, if the user, application program, operatingsystem, or the like switches focus away from the field or applicationprogram in which the text input system was opened and/or away from afield or application program that can accept text, the text input systemwill disappear and not be immediately available in the newly activatedfield or panel (although the text input system may be activated in thisnew field or panel, if desired, e.g., by the user). Then, if the userreturns to and/or returns focus to the field or application program inwhich the text input system was initially deployed and/or to anotherfield or application program that can accept text, the text input systemwill again be displayed and available upon the focus change, optionallyin the same manner and at the same relative location at which it waspreviously deployed and located. Optionally, rather than immediatelybringing up the text input system when this type of focus change takesplace, an icon or dialog box may appear that gives the user anopportunity to relaunch the text input system, if desired. Also, ifdesired, within this “in-place” mode of operation, the text input systemmay be deployed in a floating manner, in a docked manner, and/or in anydesired manner without departing from this invention. Of course, manyvariations in the operating characteristics of systems and methods inaccordance with the invention in this “in-place” operational mode arepossible without departing from the invention.

If desired, systems and methods according to at least some examples ofthe invention may include visual and/or audio indicators or reminders(e.g., associated with the activation target's location and/oractivation) to inform the user of its mode of operation, e.g., before orduring activation of the text input system. For example, if desired, theappearance of the activation targets may differ depending on whether thesystem is set to activate the target in the docked, floating, orin-place mode (e.g., rounded target edges for the floating mode v.square target edges for the docked mode, located at the very devicescreen 400 edge for floating or docked mode v. located at an individualpanel's edge for the in-place mode, etc.). As another example, ifdesired, an audible indicator may be generated during hover and/or asthe text input system is being deployed to indicate the set mode ofoperation. Other indicators or combinations of these indicators may beused, if desired, without departing from this invention. Of course, ifdesired, the user may change the mode of operation before or after thetext input system is deployed, e.g., from a menu that may be madeavailable, from radio buttons included with the text input systemdisplay, and/or in any other desired manner, without departing from thisinvention.

Of course, many variations in the user interfaces, systems, and methodsassociated with the text input system and its activation targets may beprovided without departing from this invention. For example, there maybe many variations in the manner in which the activation targets appear,the appearance or manner in which the targets switch betweenpre-interaction and post-interaction states, the manner in which thetext input systems deploy in response to interaction with the activationtargets, the manner in which the text input systems disappear, and thelike. Various examples of additional features and/or modifications ofuser interfaces, systems, and methods according to the invention aredescribed below.

As an initial default position, activation targets initially may appearalong the left edge of the screen, centered halfway along the edge orhigher, if desired. Systems and methods may return the targets to thedefault location, e.g., after certain conditions are met, as the resultof certain actions, etc. Of course, any initial default position may beused without departing from this invention.

Typically, in user interfaces, systems, and methods according toexamples of this invention, once a text input system is deployed by theuser, it will return to its original location when it is again stowed,unless the user has moved the text input system while it was in use. Ifthe text input system was moved during use (e.g., dragged to a newlocation by the user), user interfaces, systems, and methods accordingto at least some examples of the invention may display the correspondingactivation targets once the text input system is stowed at the display'sedge and at a level corresponding to the location of the text inputsystem when last opened. Of course, if desired, when the text inputsystem is stowed, the activation targets may return to their previouslocation, without departing from the invention. As still anotheralternative, if desired, when the text input system is stowed, theactivation targets may return to a default position without departingfrom the invention. Other variations in the location of the activationtargets upon stowing the text input system are possible withoutdeparting from this invention.

At least some pen-based computing systems, such as many tablet PCs, willallow users to freely change the orientation of the display screenduring use between “portrait” and “landscape” orientations. At leastsome examples of user interfaces, systems, and methods according to theinvention will position the text input system activation targets alongthe same relative edge and/or at a proportional location along thatrelative edge, based on its previous orientation, when the displayscreens are changed between the portrait and landscape orientations(e.g., from the right edge in landscape to the right edge in portrait).In this manner, when the orientation switch is made, the user will findthe activation targets in essentially the same general location as theywere located in the other orientation. Of course, other ways of handlingthis switch in orientation and/or positioning of the activation targetsmay be used without departing from the invention, such as placing theactivation targets at a default position, in a last use position fromthat orientation, etc.

In some modes of operation and/or for some application programs, it maybe desired to hide the activation target(s), at least in somesituations, such as when a user is not interacting with the target(s)and/or using the text input system. For example, when making apresentation using PowerPoint® (presentation software available fromMicrosoft Corporation of Redmond, Wash.) or the like, a user may notwish to have the activation target present and/or may wish to have itpresent only under certain limited circumstances. If desired, userinterfaces, systems, and methods according to at least some examples ofthis invention and/or for use with certain application programs or thelike may be adapted to hide the activation target(s) unless or until apen (or other user input device) is sensed at or near the edge of thedisplay where the target is located. As another example, if desired, theactivation targets in these pre-interaction situations may appear inplain text, very light, faded, and/or gray, so that they remain visiblebut not obtrusive. Then, if the user hovers the pen and/or locatesanother input device near the edge (e.g., anywhere along the edge), theactivation target could be displayed in its collapsed or pre-interactionstate and/or in a somewhat more visible state, and/or if the user hoversthe pen near the edge and near the location of the activation target,then the activation target could be displayed in its expanded stateand/or in its more fully visible and/or post-interaction state. Ofcourse, many variations in the form, appearance, and circumstances underwhich the various activation targets are displayed may be used withoutdeparting from this invention. In this manner, the target will not bereadily visible and/or a potential distraction during the bulk of apresentation, but it can be readily located and used, if necessary. Ifdesired, this type of “hide” mode for the activation targets may beentered automatically (e.g., as a default) when certain applicationprograms and/or functions are activated or launched (e.g., such as apresentation, slide show, or the like).

The illustrated examples show use of a single activation target on adisplay screen. Of course, if desired, multiple activation targets,optionally along multiple edges of the display screen and/or in multipleopen programs or panels, may be used in user interfaces, systems, andmethods without departing from this invention. For example, if desired,users could provide multiple activation targets along one edge, anactivation target at multiple corners, an activation target in each openapplication program, or the like, without departing from this invention.As still another example, a single, long activation target may beprovided along an edge of the display and the text input system may beactivated by tapping anywhere along this elongated target. In suchsystems, the text input system may be deployed at, near, or based on apredetermined relationship with respect to the location of the tap.

Finally, while the illustrated example shows use of the activationtargets and text input systems of the invention in conjunction with aword processing program, use in this environment merely constitutes anexample of use of the invention. Those skilled in the art willrecognize, of course, that a variety of text input systems may bedeployed under a great variety of circumstances, in any display paneland/or any field, and/or with any desired application program and/oroperating system or the like, without departing from this invention.

CONCLUSION

While the invention has been described with respect to specific examplesincluding presently preferred modes of carrying out the invention, thoseskilled in the art will appreciate that there are numerous variationsand permutations of the above described systems and techniques that fallwithin the spirit and scope of the invention as set forth in theappended claims.

1. One or more computer-readable storage media comprisingcomputer-readable instructions for providing a user interface on adisplay device, the user interface comprising: a first display modecomprising a pre-interaction condition of a text input system activationtarget in which the text input system activation target is invisible;and a second display mode displaying a text input system that isactivated in response to input at the text input system activationtarget in the first display mode.
 2. The one or more computer-readablestorage media of claim 1, wherein the user interface further comprises:a third display mode displaying a visible text input system activationtarget in response to input received via an input device at the textinput system activation target;
 3. The one or more computer-readablestorage media of claim 1, wherein a location of the text input systemactivation target is adjustable by a user.
 4. The one or morecomputer-readable storage media of claim 1, wherein the text inputsystem includes an electronic ink entry area that receives handwritteninput.
 5. The one or more computer-readable storage media of claim 1,wherein the text input system comprises a soft keyboard.
 6. The one ormore computer-readable storage media of claim 1, wherein the text inputsystem activation target is located in a position that overlaps a textinput box.
 7. The one or more computer-readable storage media of claim1, wherein the second display mode is displayed when a hover isperformed on the text input system activation target.
 8. The one or morecomputer-readable storage media of claim 1, wherein the input deviceincludes a touchscreen for use with a user's finger.
 9. A method foractivating and displaying a text input system on a display device,comprising: generating a text input system activation target at a firstlocation on a user interface including a plurality of visible content,the text input system activation target being invisible; receiving afirst input via an input device directed to the text input systemactivation target; and activating the text input system in response tothe first input.
 10. The method of claim 9, wherein the input deviceincludes a touchscreen for use with a user's finger.
 11. The method ofclaim 9, further comprising changing the first location of the textinput system activation target to a second location in response to achange in the content.
 12. The method of claim 9, wherein the text inputsystem activation target includes an electronic ink entry area.
 13. Themethod of claim 9, where in the first location overlaps a text inputinterface.
 14. The method of claim 13, wherein the text input systemactivation target includes a soft keyboard.
 15. The method of claim 9,further comprising: displaying the text input system activation targetas a floating interface proximate to text input areas visible on thedisplay device.
 16. A computing device, comprising: a display devicecomprising a touchscreen; one or more processing units; and one or morecomputer-readable storage media comprising computer-readableinstructions that when executed by the one or more processing unitsperform operations comprising: generating a text input system activationtarget at a first location on the touchscreen, the text input systemactivation target being invisible; recognizing a first input on atouchscreen at the first location where the text input system activationtarget is located; and displaying a text input system in response to thefirst input.
 17. The computing device of claim 16 wherein thecomputer-readable instructions when executed further perform operationscomprising: moving the text input system activation target to a newdisplay location in response to input via the input device.
 18. Thecomputing device of claim 16, wherein the first location overlaps a textinput interface.
 19. The computing device of claim 16 wherein the textinput system activation target includes an electronic ink entry area, asoft keyboard, or any combination thereof.
 20. The computing device ofclaim 16 wherein the computer-readable instructions when executedfurther perform operations comprising: displaying the text input systemactivation target in a floating manner proximate to text inputinterfaces visible on the display device.